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Abstract 



The game theoretical approach problem is considered. If goal set is controllability set 
of auxiliary control system then the original problem can be transformed into the problem 
of approach "at the moment". 

1 Introduction 

The paper is devoted to the theory of differential games. Within the framework of this theory 
the control processes with conflict or uncertainty are studied. The investigation of such problem 
started with the book of R. Isaacs p]. Basic approaches to the mathematical theory of conflict 
controlled processes were obtained by L.S. Pontryagin, N.N. Krasovski and B.N. Pshenichnyi. 
The construction of the strong mathematical theory of differential games is connected with the 
research of N.N. Krasovskii and A.I. Subbotin [2]. They have proved the alternative theorem. 
This theorem fully describes the structure of differential game. The differential game can be 
reduced to the series of ordinary control problems due to A.G. Chentsov Programmed Iteration 
Method (see [3] [6]). This reduction widely uses in this paper. 

The important class of differential games is the class of problem of approach "at the mo- 
ment". In particular these problems can be studied with the help of theory of minimax (or 
viscosity) solutions constructed by A.I. Subbotin (see [7]). In this paper the method of reduction 
of wide class of differential games to the problem of approach "at the moment" is introduced. 
The reduction is realized by the substitution of control spaces and dynamic function. Initial 
and transformed games are equivalent in the sense of Programmed Iteration Method. 



2 Definitions and Preliminaries 

Consider a differential games in which the motion of controlled system is governed by ordinary 
differential equation on the segment t £ [0, i?] 

x = f(x,u,v), x £ R, u £ P,v £ Q. (1) 

Here u £ P and v £ Q are the controls of first player and second player respectively. The first 
player tries to bring the system onto the set M, M C [0, #] x R n . The aim of the second player 
is opposite. The problem of first player is often called M- approach problem. 
The sets M, P, Q and function / satisfy the following assumptions. 

1. The target set M is closed. 
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2. P C R p , Qcffi' for appropriate natural numbers p and q. 

3. The sets P and Q are compact. 

4. /(-, ■) is continuous. 

5. /(■, -, ■) is locally lipschitzian with respect to the phase variable. 

6. /(■,-,-) satisfies sublinear growth condition. 

The differential game is considered in the class of contrstrategies of the first player and positional 
strategies of the second player. 

According to the formalization of differential game suggested by N.N. Krasovskii and 
A.I. Subbotin any function U : [0, #] x MP x Q —>■ P measurable with respect to the 3-d 
argument is called a contrstrategy of the first player, function V : [0,i?] x R™ — > Q is called 
a strategy of the second player. Let us define step-by-step and constructive motions. These 
definitions follow the book j2]. Let U be a contrstrategy of the first player, v(-) be measurable 
control of the second player, (£*,£*) be a position, A = {r k } r k=0 be a partition of the segment 
The function which satisfy the conditions 

x[t] = x[Tk-i] + / f(x[8],U{'n c - 1} x[n e -i],v(8)),v(6))d9, t G [r fc _i,r fc ]VA; G T~F, x[t ] = 

is called step-by-step motion. Obviously, such function exists and it is unique. The limits 
of step-by-step motions as fineness of partition goes to are called constructive motions in 
sense of N.N. Krasovskii and A.I. Subbotin. It is supposed that first player tries to bring all 
of constructive motions on the target set. The control of the second player is supposed to be 
formed by the rule 

v(t) = V(£i- 1 ,x[£ i - 1 ]) Vte [&-!,&)• 

Here {£i}£Lo is a partition of the segment [£*,$]. 

By the alternative theorem of N.N. Krasovskii and A.I. Subbotion [2] the solution of ap- 
proach problem is completely determined by the set of successful solvability. First player can 
bring the motion onto the target set iff it begins on the position from the solvability set. De- 
note this set by 2U. This set is maximal it-stable bridge. Moreover the solving contrstrategy is 
defined by the extremal shift rule. 

The set W is called u-stable bridge if for all v G Q and for all G W there exists 

solution of differential inclusion 

y(t) G co{f(t,x,u,v) : u G P} 

y(-) and moment £ G such that y(£) G M[£] and for all G [£*,£] the following inclusion 

holds: y(t) G W[t}. 

If the Isaacs condition 

Vs, igK™ minmax(s, f(x, u, v)) = maxmin(s, f(x, u, v)) 

uGP ueQ v£Q u&P 

is fulfilled, one can consider the differential game in the class of positional strategies (see [2]). 
Ordinary control systems are utilized in this paper also. Consider a system 

x = h(x,b), b G A. (2) 
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Denote by Sj lb the flow for time r generated by the constant control 6 G A. We suppose that 
r £ R. Let (t,, x*) € [0, $] x R n , b(-) : [0, #] — ► A be a measurable function, the solution of the 
equation 

x{t) = x* + J h{x(Z),b(£))d£ 

is called the motion of system (|2J) generated by the control b(-) and is denoted by 
We assume that f £ [0, i?]. 
Let us consider the case when b(-) is piecewise constant function. Suppose that t > t*. There 
exist the collection of numbers 7"i , . . . , Tfe £ [0, $] and the collection of controls b±, . . . ,bk £ A 
such that t = + n + . . . + r fc and = h for £ £ [£* + n + . . . + n-i, +n + . . . + r»_i + r»). 
In this case the following representation is fulfilled: 

x h (t,U,x*,b(-)) = S T h k ibk o...oS T h ] bi (x*). 

One can write an analogous representation for the case t < t*. In this < o. 

The slide controls (or measure controls) are very useful in the control theory. Consider 
the Borel cr-algebra of subsets of [0,1?] x A. Denote the set of measures defined on this a- 
algebra by H^- In the control theory the elements of H^ are called slide controls. Let \i £ 7^a, 
(£*,£*) £ [0,i?] x R n . The motion generated by slide control fx is the solution of equations 

x(t) = x* + / h(x(£), b)n(d(£, b)) for t>U, 

J[t,,t]xA 

x(t) =x*- h(x(£),b)(i(d(£, b)) for t < t*. (3) 

J[t,U]xA 

note this motion by (fh( 4 , t*, x*, fj)- If /i £ Ha then there exist a sequence of piecewise constant 
controls {b k (-)}^ =1 such that 

x h (-,U,x*,b k (-)) =4 (ph(-,t*,x*,/i), k —> oo. 

(See for details [H].) The set of ordinary controls can be embedded into the set of slide controls. 
Namely, let b(-) : [0,$] — > A be a measurable control, there exists a measure fi^.) £ Ha such 
that 

/ ^(i,6)// 6( .)(d(t,/i)) = / ^{t,b{t))dt 

J [0,i?] x A JO 

for all ^ £ C([0, i9] x A). Note that 

X h (-,-,-,b(-)) = <p h (; -, •,//&(.)). 

The problem of differential game can be reduced into the series of control problem due to 
the Programmed Iteration Method suggested by A.G. Chentsov [3]. Let us define the program 
absorption operator. This operator is defined on the family of closed subset of [0, $] x R n . Let 
us consider the controlled system (p^). For any v £ Q define the ordinary control system by the 
rule 

f v (x,u) = f(x,u,v). 
Let the the program absorption operator A be given by 

E i-> A f (E) = {(U, a;,) £ E : Wv £ Q 3fi £ H P 3£ £ [t„ ■&] : 

(^(f.t^^jGMK]) & (<p fv (t,u,x*,fj,) eE[t] Vte [**,£])}. 
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Here E C [0,$] x R n , E is closed, 

E[t] = {x : (t,x) G E}. 

Let us consider the sequence 

W 4 [0,tf] x R", W fe = ^/(Wfc-!), VA; G N. 

A.G. Chentsov established that the set of successful solvability of the first player problem can 
be represented in the form 

oo 

W=f]W k . (4) 

k=0 

Note that the u-stability condition can be written in the terms of program absorption 
operator: i.e. the set W is it-stable bridge iff A(W) = W . 

3 Main result 

Consider the differential game with controlled system (prj and target set M C [0,19] x R n . 
Denote F = M[d]. Suppose that M is controllability set of control system g(x,u>), to G f2, and 
the target set M* = x F: 

M = {(t, x) G [0, 0] x R n : 3x* G F 3/j G TZ n : x = x*, /i)}. (5) 

Here (p g (t, i?, x*, //) is defined by fl3]) It is assumed that is compact set in finitely dimensional 
euclidean space. 

Below we introduce transformed differential game "at the moment". In this game the 
resources of the first player are expanded by adding the control parameters v and u. Consider 
on the segment [0, $] the controlled system 

X = f*(x,v,u,u),v), I6l", v G {0,1}, it G P. UJ G Q, v G Q. (6) 

Here 

/* (x, i/, %U ,v) = v f(x, u, w) + (1 - i/) • g(x, u) = { * 2 J| (7) 

In system ([6]) the variables i/, it and u are controls of the first player, variable v is control of 
the second player. Consider the M*-approach problem for the system ([6]). Analogous methods 
of control problem transformation were used in the case when target set is cylinder (see [9], 

0)- 

Let us introduce the following notation. 

P* = {0, 1} x P x a 

If h — f v , it G P, then we denote SJ IU by if h — /*, it* = (z/, it, a;) G P*, then we denote 

Sl,u* b y K*V Further denote ^ = 5J )W . Let x*) G [0, 0] x R n , t G [0, i?]. If /t = /„, /i G K P , 
then we denote (fh(t,t*,x*, jj) by <fi(t,t* ). Analogously in the case h — f*, /i E TZp* 

</?(£, £*, x*, /i) is denoted by £*, x*, /i, u). Let A be the program absorption operator for the 
initial problem, A* be the program absorption operator for the transformed problem. Denote 

W = Wo = [0,i?] x R n , 
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W k = A k (W ), 



Wl = (A*) h (W ). 

Sequences {Wk}^L , {W£ }^ are constructed by the Programmed Iteration Method for the ini- 
tial and transformed problems respectively. Further let 2U and 2U* denote the sets of approach 
problem solvability for the initial and transformed games respectively. 

Theorem. Let M be a controllability set of the system (TJ|) and the target set M* = {$} x F . 
If for all u G P, v G Q, tu G Q, t', t" > flows J^ v and Q T U commute: 



then the following statements are fulfilled 

1. W k = Wl for allkeNU {0}; 

2. 2I} = 2U*/ 

3. if system (T7]j satisfies Isaacs condition, then the system fidj) satisfies the Isaacs condition 
too. 



The proof of this theorem is given in the end of section 4. 

Note that if /(-, u, v) and g(-,u>) are the smooth vector fields then the condition (jSj) may be 
written with the help of commutator of vector fields [9]: [■, ■] 

\f(-,u,v),g(;u)] = 0VueP G Q VcjGfi. 

Let us consider some examples. At first we consider the M-approach problem for system 
(JT]) when M = [0,^] x F. In this case one can choose Q = {uj}, g(x,uj) = 0. Obviously, M 
is controllability set of control system g(x,u) and target set M* = {^} x F. Further, in this 
case [f(x, u, v), g(x, cu)) = 0. Thus the initial approach is equivalent to the M*-approach for 
the conflict controlled system 

x = u ■ f(x, u,v), x G lR n , Uq G {0, 1}, ueP, v G Q. 

The transformation in this case first was suggested in [8] . In mentioned paper the statement 
2 is proved for the case of the cylindrical target set. Actually, for differential games with 
simple motions and cylindrical target case the transformation were obtained by A.I.Subbotin 
[?]. Moreover A.I. Subbotin got the formula of differential game solution in this case which is 
analogous to the formula obtained by B.N. Pshenichny [T2] . 

Now we shall consider the problem of pointing of material point at sinking island with zero 
velocity. Let $ = 1. Consider the conflict controlled system 

f y= z 

\ z — h(u, v). 
Here y and z are 3d vectors, u G P, v G Q. Suppose 

M = {{t,y,z):te[0,l},\\y\\ < 1 - t, z = 0}. 
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Hence F contains only 6d zero. Choose Q = {uj G M 3 : ||a>|| < 1}, g(x,u) = g(u) = uj. It is 
easy to prove that M is controllability set of chosen system g(x,u), uj G Q. We have (see [9]) 

[/(,.,^H]=(^)( M ^)-(^)(tO-- 

Here means zero 3x3 matrix, £7 means identity 3x3 matrix. 

Therefore the problem of pointing of material point at the sinking island is equivalent to 
the problem of approach on the point y = z = at the moment t — 1 for the system 

f V = vz+(l-u)- g(u) 

1 Z = 1/ • 1>). 

In this system first player governs by the variables v G {0, 1}, « G P, u 6 = {y £ M 3 : ||y|| < 
1}. The second player governs by the variable v G 



4 Some Properties of Program Absorption Operator 

Let us introduce one more property of sets. Let E C [0,$] x IR n . We say that decreases by 
section relative to control system g(x,uj), uj G f2, if for all (£*,£*), £ G [0,£*] and a G 72^ the 
following inclusion holds: ip g (t, t*, x*, cr) G £"[£]. 

Lemma 1. Lei i?C [0,i?]xl n . If M G E and E decreases by section relative to control system 
g(x,uj), uj G £/ien A*(i?) posses these properties. 

Proof. At first we prove that A*(E) decreases by section relative to control system g(x,u>), 
uj G Q. Let (£*,x*) G v4*(i?), £ G [0, £*], a G TZq. Our purpose is to prove that ip g (t, £*, x*, cr) G 
(A* (£))[£]. Since (£*,x*) G A*(£) C we have 

(T,ip g (r,U,x*,a)) G Vr G [£,£*]. (9) 

For all v G Q there exists measure \jl G Hp* such that </>*(£, £*, x*, /U, i>) G M[£] for some 
£ G [£*,$] and for all r G [£*,£] the inclusion c6*(r, £*, x*, /i, u) G £?[r] is fulfilled. 
Also there exists measure a G 72. p* such that 



ip(t,oj)a(d(t,p,oj,u)) = / ifr(t,oj)a(d(t,oj)) 

[0,1?] xP* </[0,i?]xn 

for all ^ G C([0,tf] x ft). 

Let fx be a measure such that 

ip(t,u*)jl(d(t,u*))= i/j(t,u*)a(d(t,u*)) + i/j(t,u*)n(d(t,u*)). 

[t,#]xP* J[t,U]xP* J\t»,&\x.P* 

Put x = (f g (t, £*, x*, cr). Note that 

V? 9 (r, £*, a;*, cr) = <^ s (r, £, x, a) = <p*(r, t, x, a, v) = 0*(r, £, x, /2, f ). (10) 

Combining ([§]) and flTTJ]) we get 

<t>*(T,t,X,fi,v)eE[T]. (11) 
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Also we have = <p g (t*,t, x, a) = 4>*(r, t, x, fj,, v). Therefore 

Since (£*,£*) G A*(E) we claim that </>*(£, t, x, ft, v) G M[£] and for all r G 
(f)*(T,t,x, £l,v) G J5[t]. Combining this with inclusion (TiTi) we obtain (t, x) G A*(P). 

The inclusion M C v4*(P) follows from the definition of A*, representation and formula 
©. □ 

Now let «*(•) : [0,$] — > P* be a piecewise function. Suppose t*,£ G [0,i9], £* < £. The 
half-interval can be represented as union of half-intervals i = such that 

u*(9) = Ui, 9 G [Ci-i, 6)- Here «i, . . . , Uk are the elements of control space P*; u* = (z/j, Ui, u^, 
Pi G {0, 1}, Ui G P, Ui G £1 Put 

J' = {i : ^ = 1} = {ri, . . . ,r z }, 
J" ±{i: Vi = 0}. 

Denote | — ii — ij + r rj , 

£ = £n- (12) 
Define the piecewise control «(•) : [£*, £) — > P by the rule 

u(t) = M rj , for t G [Ir^-i,!^)- (13) 

Suppose that £ G [£*,£]. Either there exists j such that t G [£r-j_i> £r0> or t = £. In the 
first case put 7(t) = £r 3 — l + £ — £rj_i> in the second case put 7(£) = £. Moreover denote 
J/' = {zG J": &< 7(*)} = {«!,..., «m}- 

Lemma 2. There exists piecewise control u(-) : [0, i9] — > Q such that 

x*(j(t),U,x*,u*(-),v) = x g (y(t),t,y:(t,U,x*,u(-),v),U}(-)) 

for all t G [£,£]. 

Proof. The following representation is fulfilled: 

x-( 7 (f),f.,x., «•(•), «) = ^V.?^" 1 o . . .orj; o . . . or u £(z,). 

7 l 1 ' 



We have K^v^ = Also for i G J', ^ = F£ >v , for i G J" ^ = fft. The 



flows and commute by the assumption of Theorem. Therefore 

x*(y(t),t*,x*,u*(-),v) = G T J™ o ...oQ^ 1 oFL^j- 1 o...ofi£ >v (x*). 

3 

This completes the proof. □ 

Lemma 3. Let E decrease by sections relative to g(x,u), uj G f2. Also let M C E. Then 
A(E) = A*(E). 
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Proof. At first we shall prove the inclusion A(E) C A*(E). Let (t*,x*) G A(E). By definition 
of operator A we have that for all v G Q there exist measure \x G 72p and moment £ G [£*,#] 
such that </>(£, £*, x*, //, u) G M[£] and for all t G [£*,£] the inclusion <fi(t, £*, a;*, //, G E'ft] holds. 
Since the set M is a controllability set of control system g(x,u), u G Q, there exists measure 
a G 72ft such that ip g (t, £, </>(£, £*, x*, fi, v), a, v) G M[t], t G [£, $]. By the Riss theorem one can 
choose measures fi ElZp* a ElZp* such that 

ifj(t,u)fj,(d(t,u)) = / ip(t 1 u)jl(d(t,i',u,uj)) 

[0,1?] xP J[0,i9]xP* 

for all if) G C([O,0] x P), and 



u)a(d(t, u)) = / ift(t,oj)a(d(t,is,u,oj)) 
[o,i?] xn J[o,i?]xP* 

for all ^ G C([O,0] x fi). 

Let /3 G 72p* be a measure such that for all functions t/> G C([0,t9] x P*) the following 
equalities hold: 



ip(t, is, u, u)(3(d(t, is, u, u)) = / ifj(t, is, u, u)fi(d(t, is, u,u)), 

[0,£]xP* J{0£]xP* 



^>(t, is, u, u)(3(d(t, is, u, uj) = / if}{t, is, u, u)a(d(t, is, u, uj). 

[£,i?]xP* </[£,i?]xP* 



We have 

4>*{t,t*,x*,{3,v) 



(f)(t,t*,x*,ii,v),o-,v), £e [£*,£]. 



Since M[t] C E[t] and M[&] = F we claim that (■&,<(>*('&,t*,x m ,P,v) E {$} x F and for all 
t G [£*,$] the inclusion </>*(£, £*, x*, (3, v) G 2?[£] holds. 
Now we shall prove the inclusion A*(E) C A(E). 

Choose (£*,x*) G A*(75). Let C > be a number such that for all ti,t 2 G [0, #], £2 < £i> 
x',x" G cr G 72^ the inequality 

||<^(£ 2 ,£i,x» - y? 9 (£ 2 , £i, x'» II < C\\x' - x"\\ 

is fulfilled. Here Q is the accessibility set from [0,7?] x {x*} under the action of control system 
X = f*(x,is,u,u,v), v G {0, 1} u G P, u G Vt, v G 

Inclusion (£*, x*) G A*(E) means that for all v G Q one can choose a measure /? G 72p. such 
that </>*(t9, £*, x*, /?, t?) G F and for all £ G [£*,i?] the inclusion 0(£, £*, x*, /3, i>) G £7[£] is fulfilled. 
Further there exists a sequence of piecewise controls {C a (")}^=i> C a (") : [t*,^] ~~ ¥ P* sucn that 

e a = sup ||x*(£,£*,x*, £"(•), t;) _ <t>*(t,t*,x*,/3,v)\\ —> 0,a — > oo. 
te [**,*] 

Let us consider the sequence of controls {u }^^ and sequence of moments {£ a }^Li, for those 
the elements £ a and u a are defined by the rules (|12p and f|T3|) respectively. Further for each a 
the function 7 a (-) is well defined. 

There exists a subsequence {ak} such that £ ak — > £, — ^. Without loss of generality 
it can be assumed that subsequence coincides with sequence {a}. 
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We have 7°(£ a ) = $ for all a G N. Using lemma [2] we obtain that for some control to a (-) 
the following equality holds: 

x.*(i9,U,x*,C{-),v) = x g {$,£,x{£,U,x*,u a {-),v),u a {-)). 

This is equivalent to the equality 

x(f , U, x*, u a {-),v) = x g (Z, ti, x*(tf, t m , x*, ( a (-),v),u a {-)). 

Therefore 

||x(r , £*, «"(•), r>) - x s (£, 0, <W, t., X», /?, U), «,«(•)) II < 
Since M is controllability set of control system g(x,u), u G Q, and target set {-!?} x F we have 

(r,^(r,^0*(^**,^,/3^),^ a (-))) e m. 

Consequently 

(^X^i,,!,,/!,!))) G M. 

Now let t G [£*,£]. F° r sufficient large a the inequality t < £ a is fulfilled. We have 
0*(7 a (t), £*, x*, f ) G i?[7(t)]. Using lemma (jl]) we get, that for some control u(-) the following 
equality holds: 

x(t,t,,^,u a (0,t;) = x fl (t,7 a (t),x*(7 tt (t) > ^,^,C a (0,u) J w(.)). 

Therefore 

||x(t,t*,x*, - x s (t,7 a (t),0*(7 a (t),t*,x > ,,/?,w),a;(-))|| < 

< ||x s (*,7 Q (t),x*(7 a (t),^x*,C^ < Ce"- 

Since E decreases by sections relative to control system g(x,u), to G Q and 
the inclusion (p*{^ a {t), £*, x*, (3, v) G E[y a (t)] is fulfilled, we conclude that 
x g (t ll a (t),<j)*( 1 a (t) 1 U,x*,{3,v),u;(-))eElt]. 

Since the choose of v G Q is arbitrary, we obtain G Thus it is established 

that c A(E). 

□ 

TTie proof of Main Theorem. The statement 1 follows from lemmas 1 and 3 since M C [0, $\ x 
M n and the set W = Wq = [0,-$] x M. n decreases by sections relative to control system g(x,u), 
u G Vt. 

The statement 2 obviously follows from the statement 1 and representation of the solvability 
set flU). 

Now we shall prove the statement 3. The inequality 

max min (s, f*(x, v, u, u, v)) < min max(s, f*(x, v, u, uj, v)) 

veQ (u,u,ui)eP* ' ' (u,u,lu)€P* v£Q 

is obvious. Thus, we need to prove opposite inequality. 
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Denote a saddle point in the small game for system ([I]) by (u*,v*). Let us consider two 
cases. At first suppose that 



min max(s, f*(x, v, u, lo, v)) — min max{s,/*(x,l,«,oj,i;)). 



In particular it means that 



maxmin(s, f(x, u, v)) = minmax(s, f(x, u, v)) < min(s, g(x, u)). 



In this case 



min max(s, f*{x, v, u, u, v)) = minmax(s, f(x, u, v)) = maxmin(s, f(x, u, v)) 
(i/,a,w)eP* veQ ugp vcq ' ' v£Q ueP 

= min(s, f(x, u, v*) = min{min(s, f(x, u, v*), min(s, g(x, u>))} = 

ugP ugP wGS7 



min (s, f*(x,v,u,u,v*)) < max min (s, f*(x, v, u, u, v)). 

(i/,u,u)eP* ' v£Q (v,u,u)gP* 



Now suppose that 



min max(s, f*(x, v, u, u, v)) = min max(s, f*(x, 0, u, cu, v)) = min(s, g(x, u)). 
(v,u,u>)eP* veQ «eP,we$] vgq ' uen 



Then 



min(s, g(x, u>)) = min{min(s, g(x,u)), minmax(s, f(x, u,v))} = 

u;6f2 ' ' u)£fl u€P v£Q 

= min{min(s, g(x, u)), min(s, f(x, u, u*))} = min (s, f(x, u, u, u>, v*)) < 
wen «eP (i/,u,u)eP* 

< max min (s, f (x, v, u, u>, v)). 

□ 
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